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Recycling English vocabulary through 
rational/selected deletion cloze, c-test and 
cloze-elide 


Ferit Kiligkaya 
Mehmet Akif Ersoy University, Burdur 
Turkey 


Abstract 


Cloze procedure is a technique generally used to assess learners’ reading com- 
prehension by deleting words based on a criterion. Learners are then asked to supply 
the omitted words to complete the sentences as they read the text, guessing the 
words that may be inserted based on the context. Cloze procedure can also be used 
to assess, recycle, and measure learners’ retention and production of previously 
learned vocabulary as well as improving learners’ ability to benefit from the context 
clues in a text. This paper aims to determine pre-intermediate learners’ views and 
experiences of using rational/selected deletion cloze, c-test and cloze-elide in recyc- 
ling previously studied vocabulary on the coursebook. The participants of the study 
included twenty freshmen enrolled in the General English course offered in the De- 
partment of Economics at a state university in Turkey. The participants were provided 
with a different text, including the vocabulary in the coursebook, with different cloze 
procedures, every three weeks. It was ensured that the sentences in the texts contai- 
ned enough semantic and syntax cues for the participants to determine the suitable 
words to complete the sentences. Semi-structured interviews were conducted with 
each participant every three weeks to discuss how different cloze procedures contri- 
buted to recycling vocabulary. The results of the study indicated that the participants 
valued rational/selected deletion cloze procedure more than the c-test and cloze- 
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elide as it enabled them not only to supply the suitable word in the blank but also to 
produce the word rather than to recognize it. The results also indicated that c-test 
and cloze-elide procedures were determined to be difficult and did not serve the aim 
of recycling vocabulary. 


Keywords 


recycling vocabulary, cloze procedure, rational/selected deletion cloze, c-test, 
cloze-elide 


1. Introduction 


Vocabulary knowledge is considered as a crucial component of foreign and 
second language proficiency (Nation and Waring 1997; Kamil and Hiebert 
2005; McCarthy, O’Keeffe and Walsh 2010). In other words, vocabulary is 
seen as central to teaching any language, as it is not possible to express one’s 
opinions and feelings or understand any other’s ideas without sufficient voca- 
bulary knowledge. As Wilkins (1972: 111-112) clearly pointed out: “... while 
without grammar very little can be conveyed, without vocabulary nothing can 
be conveyed”. 


The contextualization of vocabulary has received much attention in testing 
vocabulary. Rather than posing individual items that require learners to provide 
synonyms or to select the best word based on the given definition, called the 
‘discrete point approach’, it is more beneficial to provide sentences and/or 
short paragraphs where students have clues to determine which word might fit 
the context (Read 1997, 2000). For years, cloze procedure has been used in 
language classrooms to estimate learners’ overall ability by ‘measuring how 
well they can restore a reduced text to its original form’ (Hughes 2003: 187). In 
addition, it is a tool for determining a learner’s reading comprehension level. 


Another important factor that helps learners to improve their vocabulary 
knowledge is that they need to be exposed to high-frequency lexical items and 
recycle the words that they have studied, which is called the ‘frequency prin- 
ciple’ (Macalister 2016: 47; Siyanova-Chanturia and Webb 2016.). Moreover, 
learners’ attention plays an important role. Vocabulary knowledge is believed 
to improve when learners’ attention is drawn deliberately to high frequency and 
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useful lexical items. Moreover, cloze procedure can be used as a vocabulary 
reinforcement activity promoting meaning and usage (Williams 2017). 


2. Cloze procedure 


Cloze procedure is a technique generally used to assess learners’ reading 
comprehension or to determine overall language ability through deleting words 
or units based on a criterion or various other criteria such as content or func- 
tion words. According to Taylor (1953: 416), a cloze unit is “any single occur- 
rence of a successful attempt to reproduce accurately a part deleted from a 
"message" (any language product) by deciding, from the context that remains, 
what the missing part should be”. In a typical cloze test, beyond the sentence 
level, short or long passages or, in some cases, dialogues are presented to 
learners, who are then expected to complete the missing units based on se- 
mantic and syntactic features of language. The learners are asked to supply 
the omitted words to complete the sentences as they read the text, guessing 
the words that to be inserted based on the context. Writing the missing words 
requires learners to benefit from critical thinking as two mental competences, 
“syntagmatic competence” and “paradigmatic competence” are invoked in 
cloze procedures (Bailey and Curtis 2015: 101). Trying to find the missing 
word, learners first need to know what part of speech is required in the blank. 
In other words, they need to consider the rules of syntax or word order in any 
language. This process requires learners of syntagmatic competence. For 
example, if a learner is given a sentence like “I want to buy a new of 
based on the syntagmatic competence, s/he will Know that the blank should be 
replaced by a noun, not a verb. In deciding on the semantic features, on the 
other hand, learners make use of paradigmatic competence. Referring to the 
same sentence, the learner will Know that the blank cannot be filled in using 
words such as “headache” or “ear”, as the action of “buying” cannot be used 
with these words. 


There are several types of cloze procedure to assess overall language pro- 
ficiency: Fixed-ratio, Rational/selected, Cloze-elide, and C-test (Read 2000; 
Alderson 2000; Richardson, Morgan, Fleener 2009; Brown, Abeywickrama 
2010; Carter 2012; Sattarpour, Ajideh 2014; Green 2014; Bailey, Curtis 2015; 
Cheng, Fox 2017). The following examples are created from the texts on the 
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coursebook, English Break (A1 Level) by Bektas (n. d.), used in the current 
study. 


2.1. Fixed-ratio cloze procedure 


In this type of cloze procedure, every nth word (5th, 6th, 7th, 8th, or 9th) can 
be omitted, and a blank line is automatically selected in its place. In this 
respect, this procedure is considered too mechanical, and the activity pro- 
duced will include blanks which require any word such as a preposition or a 
verb. Below is an example of fixed-ratio cloze procedure, in which every se- 
venth word is omitted, leaving the first and the last sentences intact. 


We aren't a big family, | think. mother's name is Sally and my 
name is Kevin. They live in small village in London. 
I'm married. husband's name is Patrick. He's a . We 
have got a girl and boy. Our daughter's name is Sophia 
our son's name is Brandon. | got two brothers, Wil- 


liam and Benjamin William is married but Benjamin is single. 


2.2. Rational/selected cloze procedure 


In this type of cloze procedure, the blanks are selected based on some rati- 
Onal decision. For example, where the aim is to test learners’ knowledge of 
prepositions or auxiliary verbs, only prepositions or auxiliary verbs are selected 
and omitted in the text. In the following example of a fixed-ratio cloze proce- 
dure, the verbs used in daily routines were omitted, leaving the first and the 
last sentences intact. 


My name is Christian. I’m twenty years old. | with my parent. I’m 
a student at the university. | Engineering. | at 7.00 
every day. | a shower and then home at 7.45 to go to 
school. In the canteen, | a sandwich and a cup of 
coffee with my friends. | to school by bus. | at school 
at 08.15. My classes start at 08.45 and finish at 17.00. 


2.3. Cloze-elide procedure 


In this type of cloze procedure, some irrelevant or incorrect words are inser- 
ted into a given text. Learners are then asked to detect the words that do not 
belong and to cross them out. Cloze-elide procedure is also believed to test 
learners’ attention in addition to syntagmatic and paradigmatic competence. In 
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the following example of cloze-elide procedure, several irrelevant words are 


tee ” (73 


inserted into the text, such as “in”, “leave”, and “got”. 


I’m a nurse and | work at a big in hospital in the city center. My days are 
usually work very busy and tiring. Jerry works as an accountant. He has 
an office at home. | start work leave very early in the morning, but Jerry 
gets up late. | don’t have got breakfast at home. | drink a cup of tea at the 
hospital, but | don’t do eat anything. Jerry has breakfast with Tommy every 
morning. He reads the newspaper and smokes his cigarette after a break- 
fast. I’m is lucky because | don’t smoke. 


2.4. C-test procedure 


In this type of cloze procedure, the text is mutilated by removing the second 
half of every second word. Therefore, it is also called ‘second half cloze pro- 
cedure. If a word has an odd number of letters, the larger part is omitted. One- 
letter words are ignored. Moreover, the first and the last sentences are left 
intact. 


I’m in Antalya with my sister, Jessica. We a____—sihhaving ___ great 
tL = .la_— writingth_ = emaila__s aca_—s iby t_____ sea. _- 
am sit = ———s in’ t____—s garden a_——~——ihhaving ~____—s cold 
lemo_ ——— HHi_siFOtA___——s Sunny. —— knowi__ isco __ in 
Switz now, b_ _—S«s| a__ wearing sho__-——_—s arn 
san. __——s—s—i‘(wSS#SWd@SSica i= = wearing — ~~ ~white dr =———Cs aad 
ri lClrtoW SCS atte tC a «CaM and 
watc_ _——CO people. Th___—CSiS ~__-~=s couple sit_  =————sC tt 
ts next ta__ Ss i Xz THeya_———sdéfrom Switz , too. 
Th__—s are eat. =—s—S——Cw Trish ke ——Ss—C att t= ———s moment. __ is 
rea___—_—_—_—d delicious. Th__——— SSCS =~=—sd Germanfam_— so att te 
tableo_  myle_ ___. They are trying to learn Turkish from the waiter. 


3. The use of cloze procedure in research 


Cloze procedure can be considered one of the tasks based on the linguistic 
theory of structuralism, as this procedure seems to engage learners in activat- 
ing the knowledge or formal language through specific patterns such as in the 
areas of vocabulary and/or syntax. Therefore, several suggested that cloze 
procedure may prioritize students’ view of a language as a set of structures 
rather than a means of communication. This view was strengthened with the 
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emergence of Communicative Language Teaching in the 1970s by its empha- 
sis on learners’ use of language for communication. This approach calls for 
more of learners’ development of communicative competence (Hymes 1972; 
Canale and Swain 1980) than the knowledge of language patterns and struc- 
tures. In this perspective, cloze procedure lends itself to be viewed as a struc- 
tural based activity. However, as Ferlazzo and Sypnieski (2018) have indica- 
ted, cloze procedures can be tools used to enhance vocabulary and reading 
comprehension by using the clues provided in context. The studies to be re- 
viewed in this section touch upon the several features of cloze procedure and 
help us better understand its functions and status in language teaching and 
learning practices. 


A plethora of research has been conducted on the use of cloze procedure. 
The research conducted on different types of cloze procedure has yielded re- 
sults regarding the use of cloze procedure in three different contexts: as a 
measure of reading ability, as an assessment of language proficiency, and as 
a teaching device (Ereke and Okonkwo 2016). Cloze tests are reported to be a 
valid measure of general language proficiency provided that appropriate texts 
and scoring procedure are selected (Fulcher 2015). Regarding assessing vo- 
cabulary, Karimi (2011) investigated the use of c-test in assessing vocabulary 
and determined that c-test had the potential to assess vocabulary knowledge, 
while Maroko (2016) analyzed cloze testing practices in the coursebooks and 
materials used in primary schools. Poole (2012) utilized cloze test items to as- 
sess learners’ productive knowledge of concordance-based glosses for 
academic vocabulary acquisition and found that the concordance based group 
performed better than the dictionary group while producing the vocabulary in 
cloze tests. Lee (2009/2010) compared two groups of students, one of which 
did rational cloze exercises after the instructions, while the second group per- 
formed reading comprehension activities. The delayed tests conducted indica- 
ted that the group who did rational cloze exercises performed better on para- 
graph summary activities. Moreover, the students in the rational cloze group 
considered this activity more useful compared to other types of activities, as 
they believed that the cloze procedure helped them re-use the vocabulary. 


As for assessment of reading, Klapwijk (2013) suggested combining a word 
reading and cloze tests for teachers to determine their students’ reading ability 
for diagnostic purposes to better serve the students’ needs in addition to effec- 
tive instruction and assessment. Gellert and Elbro (2013), in their investigation 
of the reliability and validity of a comprehension-focused cloze test, found that 
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cloze tests were more sensitive to decoding ability than question-and-answer 
tests and those cloze tests were a good measure of learners’ self-reported 
reading difficulties. Similarly, Sattarpour and Ajideh (2014) aimed at examining 
the use of three different types of cloze procedure (cloze-elide, multiple-choice 
cloze test, and c-test) for measuring reading comprehension level. Based on 
the statistical significance analysis among these cloze types, it was concluded 
that cloze-elide, multiple-choice, and c-test cloze procedures could be used 
interchangeably to measure learners’ reading comprehension abilities. 


Previous research has also shown that cloze procedure can be effective in 
teaching vocabulary and that this technique can be highly interesting (Black- 
well, Thompson and Dziuban 1971; Norbert and Reyhner 2002). Cloze proce- 
dure is also reported to be useful for helping students to be aware of lexical 
collocations as well as grammar and vocabulary (e.g. Lee 2008; Mohammadz- 
adeh 2015). Regarding the differences among the different types of close pro- 
cedure, Lee’s study (2008) indicated that rational/selected cloze vocabulary 
activities, when combined with teacher-student discussion, were highly valued 
by secondary school low intermediate learners. Based on the results, it was 
also expressed that rational/selected cloze procedure promoted vocabulary 
learning, especially in the productive use of vocabulary and using vocabulary 
in other contexts. 


Cloze procedure can be used to assess, recycle, and measure learners’ re- 
tention and production of previously learned vocabulary as well as to improve 
learners’ ability to benefit from the context clues in a text. Unlike the other stu- 
dies conducted regarding cloze procedure, this paper aims to determine pre- 
intermediate learners’ views and experiences of using rational/selected cloze, 
c-test and cloze-elide in recycling previously studied vocabulary from a cours- 
ebook. 


4. Methodology 


4.1. Research design 


The study benefited from a mixed-method approach using both quantitative 
data obtained through the participants’ scores on each cloze text and quailitati- 
ve data collected through semi-structured interviews conducted with each par- 
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ticipant every three weeks to discuss how different cloze procedures contribu- 
ted to recycling vocabulary. 


4.2. Participants 


The participants of the study included twenty freshmen enrolled in the Ge- 
neral English course offered in the Department of Economics at a state univer- 
sity in Turkey. The participants’ average age was 18.6. Of the twenty students, 
14 were male, while 6 were female. They were all graduates of high schools 
where general English courses had been taught during the first two years of 
their programme. 


4.3. Data collection instruments and procedure 


The researcher was also the English instructor of the class in which the stu- 
dy was carried out. English Break A1 (Bestas n.d.) was used as the course- 
book, with the course covering the following units: 


e Introducing yourself 
e Giving information about people 
e Talking about possessions 


e Talking about family 


During the first week, the participants were informed of the coursebook to be 
used during the semester, teaching policy and the requirements. They were 
also informed that a study would be conducted regarding recycling vocabulary, 
and their consent was obtained. The following week the participants were pro- 
vided with hands-on practice on the three types of cloze procedure. Each pro- 
cedure was first introduced to the participants, and then example activities we- 
re conducted in the classroom. 


Every unit was covered within three weeks, and the following week, the par- 
ticipants were asked to complete three different short texts as paragraphs in- 
cluding 50 words on average. The texts were taken from the same unit and 
were similar to the ones discussed in section 2. Before conducting the study, 
the first two units were analyzed to determine the frequently used words, and 
then depending on these words, the texts on the coursebooks were selected. 
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These texts were provided in different cloze procedures, namely, ratio- 
nal/selected, c-test, and cloze-elide, including 50 words on average. Of these 
texts, four were changed into rational/selected by using the online website 
available at http://l.georges.online.fr/tools/cloze.html. The other set of four 
texts were transformed into cloze-elide procedure by the researcher, while the 
rest of the texts based on c-test procedure were prepared by using the website 
available at http://lingofox.dw.com /index.php?url=c-test. The aim was to re- 
cycle the vocabulary of each unit every three weeks and it was ensured that 
the sentences in the texts contained enough semantic and syntax cues for the 
participants to determine the suitable words to complete the sentences. The 
study lasted for 12 weeks, and each participant completed three texts for each 
type of cloze procedure, resulting in twelve texts in total. 


The semi-structured interviews took place in the researcher's office in the 
participants’ mother tongue (Turkish) and lasted 12 minutes on average. The 
participants were asked the following questions regarding their views on spe- 
cific types of cloze procedures as well as their advantages and disadvantages: 


e Which type of cloze text(s) have you found useful to review voca- 
bulary? Why? 


e Which type of cloze text(s) have you found inefficient to review voca- 
bulary? Why? 


e What are the difficulties/challenges that you have experienced while 
answering each cloze text? 


e What are the advantages/disadvantages of doing the activities in 
groups? 


e Do you have any suggestions or comments regarding the cloze texts? 


4.4, Data analysis 


The quantitative data obtained through the cloze texts were analyzed with 
the use of IBM SPSS 24. A one-way repeated measures ANOVA was used to 
determine whether there were any statistically significant differences between 
the means of three cloze procedures (rational/selected cloze, cloze-elide, and 
c-test). The qualitative data included the semi-structured interviews regarding 
the issues and challenges while completing the text in each cloze procedure. 
The responses obtained through the interviews were transcribed verbatim and 
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subject to content analysis. Since the interviews were conducted in Turkish, 
the selected quotations were translated into English and were checked against 
consistency by an EFL lecturer to ensure that the translations represented the 
responses in terms of content. 


5. Results and discussion 


A one-way repeated measures ANOVA was conducted to compare the 
average scores obtained through completing the texts in three different close 
types (rational/selected cloze, cloze-elide, and c-test. The means and standard 
deviations are presented in Table 1. There was a significant effect for the type 
of cloze procedure, Wilk’s Lambda = .035, F (2, 18) = 248.68, p < .001. A sta- 
tistically significant difference was found between the three sets of scores, and 
the effect size calculated as multivariate partial eta squared was determined to 
be = .96, which suggests a very large effect size. 


Table 1: The descriptive statistics on the average scores on the texts presented in 
three different cloze types. 


Cloze procedure N Mean Standard deviation 
Rational/selected 20 86.25 8.447 
Cloze-elide 20 52.90 8.334 
C-test 20 48.35 6.020 


While the participants obtained the highest average on the texts created ba- 
sed on the rational/selected cloze procedure (X= 86.25), the lowest average 
score was obtained on the c-test texts (48.35). The participants’ average score 
on cloze-elide texts was determined to be 52.90. Pairwise comparisons were 
also conducted to determine which set of scores obtained on different types of 
cloze procedure differed from one another. The statistical analysis related to 
these comparisons is provided in Table 2. 
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Table 2: Pairwise comparisons among the scores obtained on the types of cloze pro- 


cedures. 

(I) (J) M. difference Sid. Error Sig.” 

cloze type cloze type (I-J) 

Ratinal/selected | Cloze-elide 33.350" 2.885 .000 
C-test 37.900° 1.755 .000 

Cloze-elide Rational/selected -33.350° 2.885 .000 
C-test 4.550 1.916 .085 

C-test Rational/selected -37.900° 1.775 .000 
Cloze-elide -4.550 1.916 .085 


* The mean difference is significant at the .05 level. 


b. Adjustment for multiple comparisons: Benferroni. 


According to the statistical analysis, the participants’ scores on the ratio- 
nal/selected texts differed significantly from the other types of cloze procedure. 
The difference was found to be significant at the 0.5 level. However, no statis- 
tically significant difference was obtained between the cloze-elide and c-test (p 
>.05). Therefore, rational/selected cloze was found more useful while revie- 
wing the vocabulary, which was inconsistent with the findings of the study 
conducted by Sattarpour and Ajideh (2014), who found that cloze-elide and c- 
test could be used interchangeably. However, it is worth noting that this study 
was conducted regarding reading comprehension, rather than vocabulary 
teaching or reinforcement. The themes and codes that emerged from the 
responses, as well as the representative quotations provided during the inter- 
views are presented in Table 3. 


The participants’ responses to the rational/selected cloze procedure 


The responses regarding the positive and negative aspects of different 
cloze procedures indicate that the majority (n=19) found the rational/selected 
cloze procure highly beneficial for recycling vocabulary. This finding might be 
attributed to the fact that rational/selected cloze procedure allows the instructor 
to delete words deliberately based on their frequency in the units, and so the 
participants meet the previously-learned or studied words in context again. 


143 


Ferit Kiligkaya 


Table 3: The themes and codes that emerged during the interviews. 


Theme 


Code 


Sample Response 


Rational/Selected 


Production 


This type of exercise required me to provide the word 
that would best suit the sentence. | must admit that it 
was a difficult process. You should not only know which 
word to use to complete the word but also produce or 
write the word. | was used to multiple choice questions. 
It was a lot easier. 


Promoting 
vocabulary review 


The missing words in the texts were selected from the 
words that we studied in the coursebook. In that respect, 
I found it very useful since | recycled the words that | 
studied. Moreover, | also practiced how to spell these 
words. Compared to other types of exercises, | think that 
this one was the most useful one. 


Cloze-elide 


Promoting Syntax / 
Grammar 


| do not think that this exercise type was suitable for 
reviewing vocabulary. While trying to detect the irrele- 
vant words in the text, | was so confused. Grammar 
knowledge seems to be tested in these exercises. 


Difficult / complex 


This exercise was difficult for me because | could not 
decide which word was not needed in the sentences. | 
remembered the meanings of the words in the text, but 
could not find which one was not needed. Moreover, | 
sometimes selected a word although | later learned that 
it was necessary. It was a little bit confusing. 


No production 


This exercise was based on recognition rather than the 
production of words. | mean, we did not have to provide 
or write anything but to select the words that were not 
needed in the text. | remembered several other words 
that could be written in the blank but since it did not fit 
the blank, | could not answer some of them. 


C-test 


Difficult /complex 


It was very difficult for me to determine the word. | me- 
an, half of the word was there, but it looked so complex 
to me. It seemed like a group of letters were in front of 
me. | would also find this kind of activity in my mother 
tongue. 


Limited production 


It was good to have some cues regarding the word that 
we were supposed to write in the blanks. The first letters 
were given in the blanks, but it was still challenging for 
me and | think for my other friends. | would have rather 
liked to write the full words. 
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Group work Learning together | think it was beneficial to work with my friend while 
doing the exercises. My friends suggested words and 
we tried to come to a conclusion regarding which word 
to write in the blanks. It helped me a lot, and we learned 
from each other. 


Increased Doing the activities together with my classmates was | 
productivity and think better than the individual work. There are several 
performance reasons for this. One of them is sharing the ideas with 


others and getting feedback from them. The other is 
discussing the possible answers. | think it has a pivotal 
role in understanding why the selected words should be 
written in the blanks. 


It is widely acknowledged that vocabulary learning is a challenging process 
for both teachers and learners as one cannot assume that once any word is 
learned, it will be remembered anytime. Therefore, recycling and production 
play a pivotal role in vocabulary learning, and it can be stated that many parti- 
cipants consider rational/selected cloze superior to other types of cloze proce- 
dures since it also allows production of the words. One of the participants ex- 
presses this important role as follows: 


“This exercise allowed producing the words. | mean, we first thought 
about which word would best suit the sentence given. Then, consid- 
ering the meaning of the sentence, we wrote the word in the blank. 
Therefore, it was not enough to understand the meaning. We also 
provided the form of the word; | mean how to write it.” (Female, Inter- 
viewee ID 18) 


This finding corroborates the findings of the studies conducted by Lee 
(2008, 2009/2010), which indicated that rational/selected cloze procedure was 
considered more useful compared to other types of cloze procedures. Moreo- 
ver, this finding is also consistent with the findings of the aforementioned stu- 
dies as rational/selected seemed to promote vocabulary learning and enabled 
them to produce the words. 
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The participants’ responses on cloze-elide procedure 


The participants’ responses on the use of cloze-elide procedure clearly indi- 
cated that they (n= 18) considered this type of cloze unsuitable for recycling 
vocabulary. The participants expressed that detecting the irrelevant words in 
the texts was more related to the English syntax and grammar. They also aq- 
ded that this cloze procedure was rather difficult and confusing for them (n= 
16). As some of the participants (n=8) noted, although they knew the words in 
the sentences and remembered the meanings, they could not detect the in- 
trusive or irrelevant words in the text. This might be attributed to the fact that 
readers, especially fast and efficient ones, cannot be good at detecting these 
words (Brown and Abeywickrama 2010). The following extract brings this issue 
out clearly: 


“This exercise was rather difficult and confusing. Although | know the 
vocabulary, | mean the meaning and the spelling, | could not use this 
knowledge. | think it was based on how words follow each other [syn- 
tax] and English grammar. Therefore, | believe that it is not suitable 
for reviewing vocabulary. | had difficulty in deciding which word was 
not needed. Moreover, | did not write anything. | just crossed out the 
unnecessary word, and this, | believe, cannot encourage me to re- 
member the words.” (Male, Interviewee ID 10) 


A great majority of the participants (n= 16) stated that this exercise was ba- 
sed on recognition of the irrelevant words rather than the production of them. 
As indicated previously, the participants attached great value to the production 
of the words; as a result, they also took this into consideration while conside- 
ring this procedure insufficient in terms of recycling vocabulary. 


The participants’ responses to c-test procedure 


Similar to the responses obtained on the use of cloze-elide procedure, al- 
most all the participants (n=19) considered c-test procedure rather difficult and 
complex. The participants found that the removal of half of every second word 
resulted in a text which included many letters, making it difficult to read and to 
determine the words to fill in the blanks. As the texts were transformed into c- 
test exercises by removing every second-half of every second world, this might 
have resulted in the participants’ finding this sort of exercises difficult. Moreo- 
ver, due to the nature of this procedure, it was not possible to remove function 
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words such as “or”, “but”, and “because”. Therefore, in addition to frequently 
used words, some other items were also removed in the text. As a solution to 
this issue in further research, rational/selected cloze and c-test procedures 
may be combined, and the new procedure can be involved, called ratio- 
nal/selected c-test, in which the half of the selected words can be removed. 
One of the participants commented on this issue as follows: 

“Compared to the rational/selected cloze, | think this exercise was 

more difficult. It seemed that there were many letters, and | had diffi- 

culty in determining the words. Moreover, | was expecting the words 

that we learned but | had to provide the second half of other words. 


Therefore, | think it is not suitable for the vocabulary review.” (Male, 
Interviewee ID 8) 


The participants (n=17) found C-test procedure limited in terms of vocabula- 
ry production as they only had to provide the second half of the words. Alt- 
hough the first half of each word was provided to the learners so that they 
could guess the remaining second half, it seems that the participants did not 
appreciate this type of cue. One of the participants expressed this view as 
follows: 


“Unlike the exercise in which we wrote the words [Rational/selected 
cloze procedure], this exercise did not require writing the full sen- 
tences. Instead, we provided the half of the words. | think it does not 
suit vocabulary review, as | believe, we need to write the full words. | 
know that it provided us with some cues but remembering the full 
word is very important to me.” (Female, Interviewee ID 8) 


The participants’ responses on group work 


Since the participants worked in groups to do the exercises, their responses 
were also obtained regarding the group work. All the participants highly valued 
doing the activities in groups. The study did not aim to evaluate the effectiven- 
ess of different cloze procedures in assessing vocabulary. The participants 
provided two benefits of group work: learning together and increased producti- 
vity and performance. The participants expressed that they benefited from 
their classmates while doing the vocabulary review cloze procedures as they 
exchanged ideas and got feedback. Moreover, they valued the role of discus- 
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sion while deciding or explaining why the selected words should be written in 
the blanks. One of the participants expressed this view as follows: 


“| think doing the activities in groups was great. We worked in groups 
while doing the activities, and we enjoyed the process a lot because 
we also learned from each other. For example, when | did not under- 
stand why a specific word was needed in the blank, one of my other 
friends helped me remember the word.” (Male, Interviewee ID 19) 


To sum up, the results of the study indicated that the participants believed 
that selected deletion cloze procedure enabled them to revise the previously 
learned vocabulary items. They proposed several reasons for this view. First, 
the selected cloze procedure provided them with the necessary context to 
supply the suitable word in the blanks. Moreover, they practiced remembering 
the meaning of the words as well as producing them by writing, rather than 
recognizing. The results also indicated that that c-test and cloze-elide proce- 
dures were difficult to understand for several reasons. First, c-test required 
them to provide the second half of every second word, which was sometimes 
difficult as it was based on recognizing the word without a due focus on the 
words. Moreover, in the cloze-elide, as extra words were added, it was most of 
the time easy to determine which ones were not needed. Based on the partici- 
pants’ responses, it was concluded that cloze-elide was the least useful pro- 
cedure, as it did not encourage vocabulary revision, but metalanguage know- 
ledge. Another problem determined was that although the half of each missing 
word is provided to the participants, some answers were found to be unans- 
werable as indicated by Alderson, Clapham, and Wall (1995). Compared to 
these two cloze procedures, selected deletion cloze was determined to be bet- 
ter in recycling and assessing previously learned vocabulary items as it led to 
production through enough contents based on semantic and syntactic cues. 
The participants also believed that they were motivated to do this type of 
cloze. 


This study focused on using three different types of cloze procedure in 
enabling twenty participants to review previously-studied words in a general 
English class. Therefore, it might well be stated that the number of participants 
poses a serious concern, as it limits the results and analyses conducted, and 
the generalizability of the results to the population. However, the results can 
be transferred to similar teaching and learning contexts, and similar studies 
can be conducted to better represent the situation regarding the use of cloze 
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procedures. Based on the results, the responses provided by the participants, 
and the researcher’s experience while carrying out the study, the following im- 
plications could be put forward: 

In addition to other types of vocabulary activities used in the language class- 
rooms, different cloze procedures can be used in the language classroom as 
an aid to reviewing and recycling vocabulary, rather than merely as an asses- 
sment tool to determine learners’ reading comprehension and/or overall lan- 
guage proficiency. Therefore, they can be also used as teaching devices. 


The results of the current study indicated that the participants valued 
rational/selected cloze procedure more than the other two types of 
cloze procedure. Since in rational/selected cloze procedure the words 
are deleted deliberately, it seems that this type of procedure enables 
learners to focus more on the objectives of the lessons or units. Mo- 
reover, learners are also required to produce the words, rather than 
only to recognize them in such tests that include multiple-choice 
items. Therefore, it is suggested that teachers take this finding into 
consideration while deciding on which cloze procedure is to be intro- 
duced in their review activities into the classroom. 


The participants found c-test procedure difficult and complex, and it 
was not possible only to select the words that were frequently used in 
the coursebook. Therefore, teachers willing to use c-test procedure 
can combine both rational/selected cloze and c-test into a new proce- 
dure in which only the half of the selected words are removed. 


The results also indicated that when students are allowed to work in 
groups, in other words, collaboratively, to complete the missing 
words, it creates a pivotal interaction and promotes creative reasoning 
among the students. Working in groups can provide the learners with 
the opportunity to construct knowledge by exchanging their ideas whi- 
le focusing on the language content. Therefore, it is suggested that in 
addition to individual activities, cloze procedure can also be done in 
groups in order to allow learners to learn from each other and to 
achieve together. 


Clozes can be used as tools to improve learners’ vocabulary know- 
ledge and reading comprehension. However, to obtain these benefits, 
students can also be asked to provide reasons for their choices while 
completing the text or finding the correct answer. This is believed to 
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entail the facilitation of particular kind of interaction, which is grounded 
in meaningful discussion about their choices, possible reasons and 
help them go beyond asking learners to provide just the correct ans- 
wer. This will also help overcome the criticisms provoked towards 
cloze procedure as it focuses less on interaction and communication. 


e Learners should also be encouraged to create their own texts in diffe- 
rent cloze procedures. The texts, source materials, and guidance can 
be provided to learners by their teachers to create the cloze activities. 
The activities created then can be shared with other students. 


6. Conclusion and suggestions for further research 


This paper aimed at determining pre-intermediate learners’ views and expe- 
riences of using three different types of cloze procedures, namely, ratio- 
nal/selected deletion cloze, c-test and cloze-elide, in recycling previously stu- 
died vocabulary on the coursebook. The results indicated that of these three 
cloze procedures, rational/selected cloze was favored by the participants due 
to several reasons. One was that the missing words were deliberately based 
on the words used frequently in the units. Another reason was that the partici- 
pants produced the words while trying to determine the word that best suited 
the blank. The results also indicated that they learned from each other while 
working in groups, which increased their motivation. Regarding the limitations 
of the study, it can be stated that as the results based on the qualitative data 
were impressionistic and based on subjective responses, in further research a 
methodology can be designed that also benefits from quantitative data collec- 
tion. This can be done through an experimental study in which different types 
of texts can be used to determine and compare the participants’ success in 
remembering and using the vocabulary learned. Furthermore, as the research 
findings and conclusions from this study conducted through purposive samp- 
ling may not be generalizable to the whole population, random sampling in fu- 
ture research may help overcome this issue. 
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